ON THE BEHAVIOR OF THE COVARIANCE MATRICES IN A 
MULTIVARIATE CENTRAL LIMIT THEOREM 
UNDER SOME MIXING CONDITIONS 



Richard C. Bradley 

Department of Mathematics 

Indiana University 

Bloomington 

Indiana 47405 

USA 

bradleyr@indiana.edu 



Abstract. In a paper that appeared in 2010, C. Tone proved a multivariate central 
limit theorem for some strictly stationary random fields of random vectors satisfying cer- 
tain mixing conditions. The "normalization" of a given "partial sum" (or "block sum") 
involved matrix multiplication by a "standard —1/2 power" of its covariance matrix (a 
symmetric, positive definite matrix), and the limiting multivariate normal distribution 
had the identity matrix as its covariance matrix. The mixing assumptions in Tone's result 
implicitly imposed an upper bound on the ratios of the largest to the smallest eigenvalues 
in the covariance matrices of the partial sums. The purpose of this note is to show that 
in Tone's result, for the entire collection of the covariance matrices of the partial sums, 
there is essentially no other restriction on the relative magnitudes of the eigenvalues or on 
the (orthogonal) directions of the corresponding eigenvectors. For simplicity, the example 
given in this note will involve just random sequences, not the broader context of random 
fields. 
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1. Introduction. A multivariate central limit theorem was proved by C. Tone [26] 
for some strictly stationary random fields of random vectors satisfying certain mixing con- 
ditions. As in a somewhat related result in [6] under different dependence assumptions, 
the "normalization" of a given "partial sum" (or "block sum" ) involved matrix multiplica- 
tion by a "standard —1/2 power" of its covariance matrix (a symmetric, positive definite 
matrix), and the limiting multivariate normal distribution had the identity matrix as its 
covariance matrix. (More on that below.) The mixing assumptions in Tone's [26] result 
implicitly imposed an upper bound on the ratios of the largest to the smallest eigenvalues 
in the covariance matrices of the partial sums. The purpose of this note is to show that in 
Tone's result, for the entire collection of the covariance matrices of the partial sums, there 
is essentially no other restriction on the relative magnitudes of the eigenvalues or on the 
(orthogonal) directions of the corresponding eigenvectors. This will be elucidated with an 
example described in Theorem 1.4 below, after a special case of Tone's result is stated in 
Theorem 1.3. For simplicity, our attention in this note will be confined to just sequences 
(of random vectors), instead of the broader context of random fields. 

First, Sections 1.1 and 1.2 will give some definitions and notations and will also briefly 
review some well known, standard, elementary mathematics that will be needed. 

Notations 1.1. In what follows, the entries of matrices are real numbers. The 
transpose of any given matrix M will be denoted M l . 

Now suppose m is a positive integer. In some of the notations below, the dependence 
on this given positive integer m will be tacitly understood and not indicated explicitly. 

(A) A given element x G R m will be represented as a "column vector" (an m x 1 
matrix): x := [xi, X2, ■ ■ ■ , x m ]*. For such an x, denote the Euclidean norm as ||x|| := 
{x\ + x\ + . . . + a4) 1/2 . The origin in R m will be denoted m := [0, 0, ... , 0]*. 

(B) A symmetric m x m matrix A is "positive semi-definite" if x 1 'Ax > for all 
x G R m , and A is "positive definite" if x l Ax > (strict inequality) for all x G R m — {0 m }. 

(C) If A is a symmetric, positive definite (hence nonsingular) m x m matrix and r is 
a real number, then A r denotes the symmetric, positive definite "r th power" matrix of A. 

(It is of course defined by A r := UD r U t where (i) U is an (m x m) orthogonal matrix 
and D a diagonal matrix such that A = UDU 1 and (ii) D r is the diagonal matrix in which, 
for each i G {1, . . . , m}, the i th diagonal element is d\ where di (a positive number, an 
eigenvalue of A) is the i th diagonal element of D. The matrix A r will thereby be uniquely 
defined, even though in general the choice of matrices U and D in this procedure is not 
unique.) 

(D) For any given symmetric, positive definite m x m matrix A = (a^-, 1 < i, j < m), 
define the following two quantities: 

??min(^.) : = m i n x* Ax, and (1-1) 

x6Rtm:||x|| = l 

?7max(-4) := max x t Ax. (1.2) 

x6Rtm:||x|| = l 

(As in (1.1) and (1.2), a notation of the form oft in a subscript or superscript will typically 
be written as a t ft for typographical convenience.) In (1.1)-(1.2), the min and max are 
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both achieved for elements x on the unit sphere, and they are equal respectively to the 
smallest and largest eigenvalues of A. Each entry of A satisfies jety] < rj^^A). 

(E) For any two positive numbers a and b such that a < b, let A( m a m denote the set 
of all symmetric, positive definite mx m matrices A such that a < rj m i n (A) < r7 max (^4) < b 
(that is, the set of all such matrices whose eigenvalues are all between a and b inclusive). 

(F) For each e > 0, let Bs5Jm[e] denote the set of all symmetric (not necessarily 
positive semi-definite) m x m matrices B := (bij, 1 < i, j < m) such that \bij\ < e for all 

G {l,...,m} 2 . 

(G) If a, 6, and e are positive numbers such that me < a < 6, and A G A( m a b ) and 

B G B^m[e], then A + B G A( m)a _ me)b+me ). (The point is that for such a B, if x G R m 
is such that ||x|| = 1, then \x l Bx\ < me simply by persistent trivial applications of the 
Cauchy inequality \y t z\ < ||y|| ■ ||z|| for y,z G R m .) 

Notations 1.2. Now suppose (O, J 7 , P) is a probability space. Again suppose m is a 
positive integer. 

(A) An "R m -valued random variable" is a random vector with m (random real) co- 
ordinates. Such random vectors V will be represented as "random column vectors" (i.e. 
m x 1 random matrices): V := [Vi, V2, . . . , Vm] 1 . 

In the case where P||V|| 2 < 00 (that is, EV- 2 < 00 for each i G {1, . . . , m} — recall 
Notations 1.1(A)), the (mxm) covariance matrix of V will be denoted T, v . If also EV = m 
(that is, EVi = for each i), then one has the trivial representation = EVV 1 . The 
matrix Ey is of course (symmetric and) positive semi-definite. (In the mean m case, 
recall that for any x G R m , x^yx = E(x t V)(x t V) t = E(x t V) 2 > 0). 

(B) Suppose X := (Xk, k G Z) is a strictly stationary sequence of R m -valued random 
variables. For each n G N, define the partial sum (again, a "random mxl column vector") 
S n = S(X, n) := X\ + X 2 + ■ ■ ■ + X n . (Here and below, N denotes the set of all positive 
integers.) 

Our work will involve the case where EXq = m and P||Xo|| 2 < 00. For typographical 
convenience, the covariance matrix of X will be written E X (o) 5 an d for each n G N, the 
covariance matrix of the normalized partial sum n~ l t 2 S n will be written (with perhaps 
slight abuse of notation) as ^s(x,n)/y/n * s °f course equal to n _1 E S (x,n))- 

(C) Next let us turn to measures of dependence. For any two cr-fields A and B (c J 7 ), 
define the following four measures of dependence: First, define 

a(A,B):= sup \P{AnB)-P(A)P(B)\. (1.3) 

AeA,BeB 

Next, define the "maximal correlation coefficient" [10] 

p(A,B) :=sup|Cor%,/i)| (1.4) 

where the supremum is taken over all pairs of real-valued, square-integrable random vari- 
ables g and h such that g is ^4-measurable and h is immeasurable. Finally, define 

1 1 J 

0(A, B) := sup - ]T n B i) ~ P (A l )P(B J )\ (1.5) 

i=i j=i 
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as well as the "coefficient of information" (see e.g. [21] or [13]) 



I(A, B) := sup £ £ P ^ n B i) lo S ( p(Zp(b]) ) (L6) 

where in each of (1.5) and (1.6) the supremum is taken over all pairs of finite partitions 
{Ai, A 2 , . . . , Ai} and {£?!, S 2 , • • • , Bj} of such that Ai e A for each i and G £> for 
each j. (Here and below, "log" denotes the natural logarithm.) In (1.6) the summand is 
taken to be if either P(A{) or P(Bj) is 0. It is well known (see e.g. [3, vl, Proposition 
3.11 and Theorem 5.3(111)]) that for any two a-fields A and £>, 

4a(A,B) < p(A,B), and (1.7) 
2a{A, B) < /3{A, B) < y/l(A,B). (1.8) 

(D) Now again suppose X := (Xk,k G Z) is a strictly stationary sequence of Re- 
valued random variables. (No assumptions on moments.) For any integer j, define the 
cr-fields '■= cr(X k , k < j) and J-J := a(Xf., k > j). (Here and below, a(. . .) denotes 

the cr-field C J 7 generated by (. . .).) For each positive integer n, define the following five 
dependence coefficients: 



a(n) = a(X,n) := a^^F™)- (1.9) 
p(n) = p(X,n) := p{J* (1-10) 

P{n) = 0(X,n) := (1-H) 

I(n) = I(X,n):=I(F _ oo ^™); and (1.12) 

p*{n) = p*{X,n) :=snpp(a(X k ,keT),a(X k ,ke A)) (1.13) 



where the supremum in (1.13) is taken over all pairs of nonempty, disjoint subsets V and A 
of Z such that dist(r, A) := mm ge r ihe A \g — h\ > n. (The sets V and A can be "interlaced," 
i.e. with each one containing elements between ones in the other set.) Of course by strict 
stationarity, a(n) = a{J rJ _ 00 ,J r p rn ) for any integer j; and the analogous comment applies 
to (1.10), (1.11), and (1.12). 

The given strictly stationary sequence X is said to satisfy 
"strong mixing" [23] if a(n) — > as n — > oo, 
"p-mixing" [15] if p(n) — > as n — > oo, 
"absolute regularity" [29] if f3(n) — > as n — > oo, 
"information regularity" [21] [29] if I(n) — > as n — > oo, and 
"p*-mixing" [24] [25] if p*(n) ->■ as n ->■ oo. 

(The mixing condition in [24] looked somewhat different from p*-mixing, but turned out to 
be equivalent to it in the context in that paper; see [3, vl, Theorem 5.13].) By (1.7)-(1.8) 
and (1.9)-(1.13), the following implications hold: 

(i) p* -mixing implies p-mixing, 

(ii) p-mixing implies strong mixing, 

(iii) information regularity implies absolute regularity, and 
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(iv) absolute regularity implies strong mixing. 

With the possible exception of information regularity, all of these conditions have 
played a major role in limit theory for weakly dependent random variables; see e.g. the 
books [1], [3], [9], [17], and [22]. Information regularity is sometimes a handy tool in the 
study of stationary Gaussian sequences; see e.g. [13, Chapter 4] or [3, v3, Chapter 27]. 

Peligrad [19, Corollary 2.3] proved a central limit theorem for strictly stationary se- 
quences of real-valued, square-integrable random variables satisfying the dependence as- 
sumptions p*(l) < 1 and a(n) — > as n — > oo. That result was generalized to strictly 
stationary random fields of real-valued random variables by Perera [20, Proposition 3] 
(with the sums being taken over a broad class of sets of indices, not just "rectangular 
blocks"). It was generalized again in [3, v3, Corollary 29.33] — again to strictly stationary 
random fields of real-valued random variables — with another, less restrictive generaliza- 
tion (to random fields) of the dependence coefficient p*(l) (but with the sums taken over 
just the usual "rectangular blocks" of indices). Later, for an arbitrary positive integer m, 
Tone [26, Theorem 1.1] generalized that latter result to strictly stationary random fields 
of R m -valued random variables. For simplicity, we shall state her result here for just the 
special case of random sequences: 

Theorem 1.3 (Tone [26]; Peligrad [19] for m = 1). Suppose m is a positive integer. 
Suppose X := (X^, k G Z) is a strictly stationary sequence of -valued random variables 
such that EXq = m and E\\Xo\\ 2 < oo, and the covariance matrix £x(o) 1S positive 
definite (hence nonsingular) . Suppose also that p*(X, 1) < 1 and that a(X,n) — > as 
n — > oo. Then the following two statements hold: 

(1) For each n e N, the covariance matrix £s(x,n) 1S positive definite (hence nonsin- 
gular). 

(2) One has that (see Notations 1.1(C) and 1.2(A)) 

E S(x,n) S ( X ' n ) ^N(O m ,I m ) asrwoc. (1.14) 

Here in (1.14), the notation =>• means convergence in distribution on (the Borel a-field 
of) R m , and the notation iV(O m , I m ) refers to the multivariate normal distribution on R m 
whose mean vector is m and whose covariance matrix is the Tn x Tfi identity matrix I m . 
The left side of (1.14) is an R m -valued random variable ("random m x 1 column vector") 
resulting from the matrix multiplication indicated there. 

Under different dependence assumptions, again in the more general context of strictly 
stationary random fields, Bulinskii and Kryzhanovskaya [6, eq. (1.13) and Theorem 2] 
reformulated a multivariate central limit theorem in [7] into the form (1.14), with the same 
use of the "standard —1/2 power" of the covariance matrix £s(x,n) as "normalization," 
and then treated a related central limit theorem of the form (1.14) involving the use of the 
"standard —1/2 power" of a sample covariance matrix ^s(x,n) as "normalization." (Those 
results will not be treated further here.) 

Here is our main result (recall Notations 1.1(E)): 
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Theorem 1.4. Suppose m is a positive integer. Suppose a, b and r are positive 
real numbers such that a < b. Then there exists a strictly stationary Gaussian sequence 
X := (Xk, fceZ) of TV 11 -valued, mean-O m random variables with the following properties: 

(1) p*(X,l)<l. 

(2) max{/(A, 1), (3(X, 1), a(X, l),p(X, 1)} < r. 

(3) max{/(A, n), /3(X, n), a(X, n),p(X, n)} — y as n — > oo. 

(4) For every element (mxm matrix) G G h( m , a ,b), there exists an infinite set Q C N 
such that 

s S(x,n)/v^ -> G as n ->■ oo, n G Q. (1.15) 

Statements (2) and (3) have some redundancy (see (1.7)-(1.8)), but that is harmless. 
Of course (1.15) means that for every G {1, 2, ... , m} 2 , the (i, j)-entry of the matrix 
^S{x,n)/y/n converges to the (i,j)-entry of the matrix G as n — y oo, n G Q. Also, the 
statement that X is a "Gaussian sequence" means of course that for any positive integer L 
and any distinct integers k(l), k(2), . . . , k(L), the joint distribution of the random vectors 
-X"fc(2)> • • • > -^fc(L) is a (possibly degenerate) multivariate normal distribution on R Lm . 

Theorem 1.4 will be proved in Section 3, after some preliminary work is done in Section 
2. In the rest of Section 1 here, a few comments on this theorem will be given. 

Under the assumptions of Theorem 1.3, Tone [26, Claim 3.1] showed that for the 
covariance matrices ~£<s(x,n), the ratio of the largest to smallest eigenvalues is bounded, and 
that in fact there exists a pair of positive numbers a < b such that ^s(x n)/^/n ^ ^-(m,a,b) 
for all n G N. Thus in property (4) in Theorem 1.4, the restriction to matrices in A( mj£lj &) 
(for some pair of positive numbers a < b) is unavoidable. 

In Theorem 1.4, property (3) cannot be extended to include p*(X, n) — y as n — y oo, 
for that (in conjunction with certain other properties in Theorem 1.4) would force the 
covariance matrices ^s{x,n)/^/n t° converge to a limiting matrix as n — y oo (a fact implicitly 
contained in another, somewhat related result of Tone [27, Theorem 3.2]), contradicting 
property (4). Also, in Theorem 1.4, the larger the ratio b/a is, the closer p*(X, 1) has to 
be to 1. That insight ultimately goes back (in light of basic results in [15]) to work of 
Moore [18] involving a closely related condition. 

For random sequences and random fields respectively, classes of examples constructed 
in [3, v3, Theorem 26.8] and [4, Theorem 1.9] "separate" various different but related 
mixing assumptions used in [2], [3], [19], [20], [26], [27], and other related works. In 
particular, the latter class of examples (in [4]) "separates" the two generalizations (to 
random fields) of the dependence coefficient p*(l) (in [20], and in [3] and [26]) implicitly 
alluded to prior to Theorem 1.3. 

In (1.15), regardless of whether or not the eigenvalues of G are simple, one can trivially 
consider a further subsequence in which the eigenvalues and m orthogonal unit eigenvectors 
of the matrices ^s{x,n)/^/n au converge; by a simple calculation, their limits must be the 
eigenvalues and m orthogonal unit eigenvectors of G. As a consequence, in Theorem 1.3, 
for the covariance matrices £s(x,n) 7 the relative magnitudes of the eigenvalues, and the 
respective (orthogonal) directions of their eigenvectors, can range essentially arbitrarily 
- within some upper bound (as noted above) on the ratio of the largest to smallest 
eigenvalues. In this respect, Theorem 1.4 helps to "separate" Theorem 1.3 from other, 
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more conventional multivariate central limit theorems (such as the one in [27, Theorem 
3.2] alluded to above) in which there is a "limiting covariance matrix." 

It was noted above that in the special case of real- valued random variables (i.e. m = 1), 
Theorem 1.3 boils down to a central limit theorem of Peligrad [19]. The author [2] (see 
also [3, v3, Theorem 27.12]) gave a construction (a variant of ones in [11] and [5]) that 
showed that in that result of Peligrad, the growth of the variances need not be asymptot- 
ically linear, but can instead "wobble" between two different linear rates of growth. That 
construction was in spirit (though not fully in letter) a version of Theorem 1.4 for the case 
m = 1 (real- valued random variables). 

As was noted above, Theorem 1.3 is actually just a special case of a result of Tone [26, 
Theorem 1.1], which in its full generality involved random fields (of R m - valued random 
variables) indexed by Z d for an arbitrary positive integer d. By modifying the arguments 
below, one can prove a version of Theorem 1.4 for such random fields for arbitrary (m 
and) d. However, in the case d > 2, for such a construction, the information in Theorem 
1.4 that pertains to the dependence coefficients /3(n) and I(n) unavoidably becomes false 
and has to be omitted; see [3, v3, Theorem 29.9]. 

As a simple corollary of Theorem 1.4 itself, one can derive a version of Theorem 1.4 
in which the sequence X is not Gaussian. One can simply apply Theorem 1.4 itself with 
a replaced by some number a' G (0,a), then fix s > such that a' + e < a, and then 
replace X k by X k + [V k {1) , V k {2 \ V^] 1 where ivjf \ k e Z, i e {1, . . . , m}) is a family 
of independent, identically distributed real-valued random variables, this family being in- 
dependent of the sequence X, with the 's each taking the values y/e and —\fe with 
probability 1/2 each. 

2. Preliminaries. This section will lay some groundwork for the proof, in Section 
3, of Theorem 1.4. 

The random sequence X described in Theorem 1.4 will be constructed (in Section 3) 
from a family of independent "building block" random sequences of a relatively simple 
structure. The following lemma will play a role in that process of "assembly." 

Lemma 2.1. Suppose (O, T , P) is a probability space, L is a positive integer, and At 
and Be, £ e {1, 2, . . . , L} are a-fields (C T) such that the a-Selds At V Be, £ e {1, . . . , L} 
are independent. Then 

L L 

p(\J At, \/ B £ ) = max L p(A e ,Bt), and (2.1) 
i=i i=i 

L L L 

J(V At, \jBt) =Y J I{AM- (2-2) 

t=i i=i t=i 



Proofs of these equalities can be found e.g. in [3, vl, Theorems 6.1 and 6.2 (VIII)]. 
Eq. (2.1) is due to Csaki and Fischer [8, Theorem 6.2]. Eq. (2.2) is a classic fact from 
information theory; see e.g. its role in Pinsker [21]. 
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The "building blocks" for the construction (in Section 3) of the sequence X for The- 
orem 1.4 will be stationary Gaussian sequences of centered real- valued random variables. 
They will be identified (in Section 3) via a careful choice of their spectral densities. The 
rest of Section 2 here will lay some groundwork for that procedure. 

Notations 2.2. With slight abuse of terminology, a real Borel function / on [— tt, it] 
will be said to be "symmetric" if /(—A) = /(A) for a.e. A G [— tt, tt]. 

(A) Suppose / is a real, nonnegative, Borel, symmetric, integrable function on [—tt, tt]. 
Suppose W := (W&, k G Z) is a strictly stationary sequence of real- valued, centered, square- 
integrable random variables. Then / is a "spectral density function" for the sequence W 
if the following holds: 



If W has a spectral density function, then it will be unique modulo sets of Lebesgue 
measure 0. The convention on spectral density used here is as in [3]; it differs by a factor 
of 2n from a more standard convention used in other references. 

(B) For each positive integer n, define the real, nonnegative, symmetric, continuous 
function (the Fejer kernel) F n on [— tt, tt] as follows: 



(C) It is well known that if W and / are as in (A) above, with / being the spectral 
density function of W, then for each positive integer n, 



See e.g. [3, vl, the Note after Lemma 8.18]. 

Lemma 2.3. Suppose W := (Wk, k G Z) is a stationary real mean-zero Gaussian 
random sequence that has a spectral density f on [—tt, tt] that is bounded a.e. between 
two positive constants. Then p*(W, 1) < 1. 

An elementary proof of this lemma can be found in [3, vl, Theorem 9.8(111)]. (It 
yields the inequality p*(W, 1) < 1 — a/b where < a < b and a < f < b a.e. The sharper 
inequality p*(W, 1) < (1 — a/b)/(l + a/b) holds as a result of a more sophisticated argument 
of Moore [18] in a closely related context.) 

The analysis that follows will now involve certain real, Borel, symmetric functions / 
on [—tt, tt] that can take (perhaps even exclusively) negative values — with the intent to 
use, for some such functions / later on, the positive function A >->■ e-^ A ) as the spectral 
density for a stationary Gaussian sequence. 




(2.3) 




(1/n) • [sin 2 (nA/2)]/[sin 2 (A/2)] if A G [-tt, tt] - {0} 
n if A = 0. 



(2.4) 




(2.5) 
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Notations 2.4. (A) For any (not necessarily nonnegative) real, Borel, square- 
integrable, symmetric function / on [— tt, tt], define the quantity 

oo 

*(/):= W>h (2-6) 
fc=i 

where for each fceN, 

/ kX fW^- ( 2 - 7 ) 

Of course Y^T=i V 7 / k < °°; an< ^ w hh -!/;/, o := (27r) _1 f(X)d\, one has that 

X^fclo V'/./c cos(fcA) converges in £ 2 to / (and one can say more). However, the quantity 

^(/) may be infinite. 

(B) For any two real, Borel, square-integrable, symmetric functions / and g on [—it, tt], 
one has that ifjf +gj k = tpf^ + tpg^ for each k (see (2.7)), and by (2.6) and Minkowski's 
inequality, [&(f + g)] 1 ^ 2 < [^(/)] 1//2 + [^(fiO] 1 ^ 2 (where if necessary, oo 

(C) Suppose a and b are real numbers such that a < b. Suppose /, /i, /2, ^3, ... is a 
sequence of real, Borel, symmetric functions on [—tt, tt] that are each bounded a.e. between 
a and 6, and f n — >■ / a.e. as n — >■ 00. If r is a positive number and *&(f n ) < t for every 
?i G N, then #(/) < r. 

(This formulation is unnecessarily restrictive, but will fit our applications later on. 
The point is that for each k, ifjf( n ),k (where f(n) means f n ) converges to V , /,fc as n — > 00, 

and hence for each positive integer L, Ylk=i k — r ' an< ^ nence the same is true with L 
replaced by 00.) 

(D) If / is a real, Borel, square-integrable, symmetric function on [—tt, tt] such that 
*(/) < 00, then f* n e f Md\ < 00. (This is a special case of a classic result of Lebe- 
dev and Milin [16]. For a detailed exposition of this, see e.g. [3, v3, Appendix, Theorem 
A2744(VII)].) 

Lemma 2.5. For every e > 0, there exists 5 = 5(e) > such that the following holds: 
Suppose W := k G Z) is a stationary real mean-zero Gaussian random sequence 
with a spectral density function g of the form g(X) = e^ x \ A G [— tt,tt], where f is a 
real, Borel, square-integrable, symmetric function on [— tt, tt] such that ^(/) < S; then 
I{W, 1) < e. 

This lemma is implicitly contained in arguments of Ibragimov, Rozanov, and Solev in 
[12] [14] (see also [13, Chapter 4]). A detailed, explicit proof of this lemma can be found in 
[3, v3, Theorem 27.11]. 

Lemma 2.6. Suppose Ti, and T 2 , and are real numbers such that 

Ti < 9 < T 2 . (2.8) 

Suppose 5 > and e > 0. 
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Suppose N is a positive integer. 

Suppose f is a real, continuous, symmetric function on [— tt, 7r] such that 

Ti < /(A) < T 2 for all A G [-tt, tt] and (2.9) 
*(/) < 5. (2.10) 

Then there exists a real, continuous, symmetric function h = fa(/,T(i),T(2),6>,5,e,iV) on 
[— 7r, 7r] (where tie notations T(l) and T(2) mean Ti and T 2/ ) with the following five 
properties: 

For every A G [-7r,7r], Ti < h(A) < T 2 ; (2.11) 
#(/i) < 5; (2.12) 
|h(0)-#|<£; (2.13) 

/ \h(X)- f(X)\dX<e; and (2.14) 

J —TT 

/TT f-TT 
F n (X)-e h ^d\- F n (X) -e f{x) d\ \< e. (2.15) 
-TT J — TT 

Proof. Refer to (2.8) and (2.9). We shall first carry out the proof of Lemma 2.6 
under the following extra assumption: 

9 > /(0). (2.16) 

Since / is (by assumption) continuous on the closed interval [— tt, tt], it follows (see 
(2.8), (2.9), and (2.16)) that there exists a number cq (henceforth fixed) with the following 
three properties: 

< c <min{l, 0-/(0)}; (2.17) 
Ti < /(A) - c < /(A) + c < T 2 for all A e [-tt, tt]; and (2.18) 
|/(A)-/(O)|<T 2 -0 for all AG [-c , c ]. (2.19) 

For each c G (0, c ], define the positive numbers a Cj fc, k G N as follows: 

n ._ / (c 2 A) • (l/*0 iffc = lor2 

c ' fc '" \(c 2 /7r)-(l/A;)-l/(logfc) if fe > 3. 1 J 

Then for each c G (0, c ], one has by (2.17) and (2.20) that 

9 - /(0) > a c ,i > a c , 2 > a c , 3 > • • • I (2.21) 

and that YlT=i ttc , k = 00 • Accordingly, for each c G (0, Co], let M(c) denote the greatest 
positive integer such that (see the first inequality in (2.21)) 

M(c) 

J2a c , k <9-f(0). (2.22) 

k=i 
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For each c G (0, Cq], define the real, continuous, symmetric function g c on [— tt, it] as follows: 
For A G [— 7r, 7r], 

M(c) 

g c (X) := ^2 a c ,kCos(k\). (2.23) 
k=i 

Now suppose c is an arbitrary fixed number such that c G (0, Co]. From (2.23), (2.20), 
the monotonicity in (2.21), and a standard fact for trigonometric series with nonnegative, 
monotonically decreasing coefficients (see [3, v3, Appendix, Lemma A2712] - take the 
real parts there — or [30, p. 3, Theorem (2.2)]), one has that for any A G [c, tt], 

|<7c(A)| < (tt/A) • a c ,i = (tt/A) • (c 2 /tt) < c. 

Next suppose for just a moment that A G (0, c]. Then 0<A<c<c o <lby (2.17). Let 
/ denote the positive integer such that J<l/A</ + 1. Then for all k G {1, 2, . . . , /}, 
one has that kX < 1 and hence cos(/cA) > 0. If M(c) < /, then it follows from (2.23) and 
(2.20) that <7 C (A) > 0. If instead M(c) > /, then one has J2 k=1 a c ,k cos(fcA) > and (since 
1 < A • (/+ 1)) again by (2.20), (2.17), and the monotonicity in (2.21), (again see [3, v3, 
Lemma A2712] or [30, p. 3]) 

M(c) 

| a ^ cos(fcA) I < (tt/A) ■a cJ+1 < (tt/A) • (c 2 /n) ■ (1/(1+1)) < c 2 < c, 

k=I+l 

and hence ^ C (A) > — c by (2.23). Putting all these pieces together (see also (2.22) and 
(2.23) again), one now has that 

\g c (X)\ < c for all A G [c,tt]; and (2.24) 

M(c) 

- c < g c (X) < J2 a c,k <e- /(0) for all A G [0,c]. (2.25) 

k=i 

(Eq. (2.25) was shown above for A G (0, c]; it extends to A = by continuity of the 
function (7 C .) By (2.18), (2.24), and (2.18) again (keeping in mind our ongoing assumption 
c G (0, c ]), one has that for all A G [c, 7r], 

Ti < /(A) - c < /(A) + y c (A) < /(A) + c < T 2 . 

By (2.18), (2.25), and (2.19), for all A G [0,c], 

Ti < /(A) - c < /(A) + <7 C (A) < /(A) + 6 - /(0) < T 2 - + (9 = T 2 . 

Hence by symmetry, one now has that 

Ti < /(A) + y c (A) < T 2 for all A G [-tt, tt], (2.26) 
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Equations (2.24), (2.25), and (2.26) were shown for any arbitrary c G (0, c ]. Our plan 
now is to let the function h be defined by 



h:=f + g c (2.27) 

for some sufficiently small c G (0,co]. To start off, note that under (2.27) for any given 
c G (0, c ], (2.11) holds by (2.26). 

Next, by (2.20), for each c G (0, c ], 



CXD 



E fc • <k = ( C 'A 2 ) • [l + (V2) + £ l/[fc(log kf 

k=l ' fc=3 



< oo; 



and in fact the middle term converges to as c — > 0+. Hence by (2.23) and (2.6)-(2.7), 
V(g c ) ->■ as c ->■ 0+. Hence by (2.10) and Notations 2.4(B), [*(/ + # c )] 1/2 < 5 1/2 for 
all c G (0, Co] sufficiently small. Thus under (2.27), eq. (2.12) holds for all c G (0, cq] 
sufficiently small. 

Next, for each c G (0, Co], by the definition of the positive integer M(c) (see the entire 
sentence containing (2.22)), followed by (2.20), one has that 

M(c) M(c) + 1 M(c) 

< [6 - /(0)] - £ a C)fc < £ a C)fc - £ a Cjfc = a c>M ( c )+i < c 2 / 71 "- 
fc=i fc=i k=i 

That is, by (2.23), < [0 - /(0)] - # c (0) < c 2 /tt, that is, < - [/(0) + ^ c (0)] < c 2 /tt. 
Hence under (2.27), eq. (2.13) holds for all c G (0, Co] sufficiently small. 

Next, by (2.24) and symmetry, for every A G [— 7r,7r] — {0}, <7 C (A) — > as c — >■ 0+. 
Hence by (2.9), (2.26), and dominated convergence, (2.14) holds (under (2.27)) for all 
c G (0, Co] sufficiently small. Also, since each Fejer kernel (see (2.4)) is bounded, and 
by (2.9) and (2.26) the functions exp(/(A)) and exp(/(A) + <7c(A)) (for c G (0, Co]) are 
uniformly bounded (between expTi and expT2), one has by dominated convergence that 
(under (2.27)) eq. (2.15) holds for all c G (0, cq] sufficiently small. Thus under (2.27), eqs. 
(2.11)-(2.15) hold for all c G (0, c ] sufficiently small. Thus Lemma 2.6 holds under the 
extra assumption (2.16). 

It will be useful to note that, again under the extra assumption (2.16), one can expand 
the statement of Lemma 2.6 to include the following variant of (2.15): 

F n (A)-e-^ (A) rfA- / F n (X)-e- fW d\ < e. (2.28) 

-7T J — 7T 

To accomplish this, one shows that under (2.27), eq. (2.28) holds for all c G (0, Co] suffi- 
ciently small. The argument is essentially the same as the corresponding one for (2.15) in 
the preceding paragraph. 

Now let us briefly take care of the cases where (2.16) does not hold. Refer to (2.8) 
and (2.9) again. If 6 = /(0), then let h := / and we are done. Finally, if 6 < /(0), then 
by replacing Ti, T 2 , 6>, and / by — T 2 , — Ti, —6, and — / (note that /) = *(/) by 
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(2.6)-(2.7)), one trivially converts to the case where (2.16) holds. (The resulting function, 
say h, is then multiplied by —1 to produce the final function h. In order for (2.15) to 
result at the end of this "trivial conversion argument," it was vital to derive the "extra" 
fact (2.28) at the end of the argument under (2.16) above.) That completes the proof of 
Lemma 2.6. 



3. Proof of Theorem 1.4. The proof will be written out here for the case m > 2. 

(The argument for the case m = 1 is similar but less complicated.) The proof will be 
divided into several "steps." (One of those "steps" will be a "lemma.") 

Step 3.1. Refer to the statement of Theorem 1.4. Decreasing r and/or a and/or 
increasing b if necessary, we assume without loss of generality that 

< a < 1< b and (3.1) 
0<r<l. (3.2) 

Let us identify the set of all (real) m x m matrices with R m ^ 2 (with each entry in 
the matrix identified with a coordinate in R m ^ 2 ). The set R m ^ 2 is separable. Hence 
every nonempty subset of R m ^ 2 is separable (an elementary fact — see e.g. [3, v3, Ap- 
pendix, Lemma A3101]). Accordingly, let A be a countable dense subset of A.( m , a ,b)- Let 
G\, G 2 , Gs, . . . be a sequence of elements of A such that (for convenience) each element of 
A is listed infinitely many times in that sequence. 

In order to prove Theorem 1.4, it suffices to construct a strictly stationary, mean-O m 
Gaussian sequence X := (Xk, k G Z) of R m - valued random variables such that properties 
(1), (2), and (3) in Theorem 1.4 hold as well as the following property: (4') There exists 
a strictly increasing sequence (AT 1; N 3 , . . .) of positive integers, and a positive number 
6, such that (recall Notations 1.1(F)) for all n G N sufficiently large, 

S S(X,JV(«))/ v /%) ~~ Gn e B STm[ 2 n<S> ]- ( 3 - 3 ) 

(Here and throughout the rest of this note, when the notation N n appears in a subscript, 
it will be written N(n) for typographical convenience.) It will then follow trivially that 
each member G G A would be the limit of a subsequence of the matrices . , . T , . 

S{X,N{n))/^N{n) 

(for the integers n such that G n = G); and property (4) in Theorem 1.4 would then follow 
as an easy consequence. 

We shall return to the matrices G n in Step 3.5 below. 

Step 3.2. Refer again to (3.1). In what follows, for convenience, our attention will 
be "expanded" from A( m)a>6 ) to to A (m)a / 2)2b) . 
Define the positive number 

7 := a/(20m 2 ). (3.4) 

Define the ("lattice") set 

L :={... , -3 7 , -2 7 , -7, 0, 7, 27, 3 7, • • •} (3-5) 
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(that is, the set of all real numbers of the form £7, k G Z). Let A L denote the set of 
all m x m matrices H := (hij, 1 < i,j < m) G A( ma / 2 ,2&) such that G L for every 
(z,j) G {l,...,m} 2 . By Notations 1.1(D)(E) (see the third sentence after (1.2)), the set 
A( m>a /2,26) is bounded (as represented as a subset of R m ^ 2 ). It follows that Al is a finite 
set. Of course the set Al is nonempty. (For example, cl m G Al where c is an element of 
L such that a/2 < c < a — such a c exists by (3.4).) Define the positive integer 

L:=cardA L . (3.6) 

Let the elements of Al be denoted as Qi ,Q^\ • • • , Ql \ with the representation 

Q ( e 1] :=(gg,l<i,j<m) (3.7) 

for £ G {1, 2, . . . , L}. These matrices are of course symmetric and positive definite 
(since they belong to A( m>a / 2>2 &))- 

Step 3.3. Two other classes of matrices will be needed. (These matrices will be 
symmetric but not positive definite.) 

(2*1 (2*1 

For each u G {1, . . . , m}, let Q u '■= {lu/j, 1 < h J ' < TO ) denote the (symmetric) mxm 
matrix defined by 

„(2) ._ / 1 if (*> j) = («»«) /o 
«uy • | for all other (z, 7). 1 J 

Now recall the assumption m > 2 made in the first sentence of Section 3. Let T 
denote the set of all ordered pairs (it, v) G {1, . . . , m} 2 such that u < v. For each ordered 

pair (it,u) G T, let Quv '■= (Quviji 1 — hJ ' — m ) denote the (symmetric) mxm matrix 
defined by 

J3) .fl if e { (u,u),(u,v), (u,u),(v,u)} , . 

Vuvij ■ | for all other (z,j). K } 

Now to set the stage for the next lemma (and for some other calculations below), note 
that trivially by (3.1) and (3.4), r y/{2bL) < 7 < 10m7 < 1. 

Lemma 3.4. For every matrix G G A-( m ,a,b), there exists an array 

c = c(G) := I G {1, 2, . . . , L}; c£\u G {1, 2, . . . , m}; cg>, (u, u) G t} (3.10) 

of positive numbers such that the following statements hold: 

Wg{1,...,L}, 7/(26L) < 4 1} < 1; (3.11) 

Vw G {l,...,m}, 2m7 < c^ 2) < 10m7; (3.12) 

V(V)£T, 2 7 < eg? < 5 7 ; (3.13) 

and 

L m 

G = j:4 1) Q[ 1) + j: ci u ) Q i u ) + E c ^«- ( 3 - 14 ) 

£=1 w=l (u,v)€T 
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Proof. Represent the matrix G by 

G:=( 9ij ,l<i,j<m). (3.15) 

Of course by the hypothesis and Notations 1.1(E), G is symmetric. For each G 
{1, . . . , m} 2 , let Kij denote the integer such that (see (3.4)) 

Kijl < 9ij < («y + 1)7- (3-16) 
Then Define the (symmetric) m x m matrix H := (hij, 1 < i,j < m) as follows: 

Vz G {1, . . . , m}, ha := (ku — 8m)7; and (3-17) 
V(i, j) G T, = hji := (n tJ - 3) 7 . (3.18) 

Now for each (i, j) G {1, . . . , m} 2 , 

- < Ifi'ij - «y7l + \ K *j1 ~ (3.19) 

In the right side of (3.19), the first term is bounded above by 7 (by (3.16)), and the second 
term is either 87717 ( if i = j) or 37 (if i ^ j), by (3.17)-(3.18). Hence G-H G B^[8m7]. 
Recall from (3.4) and (3.1) that 8m 2 7 < a/2 < b. Since (by hypothesis) G G A( m a 6 ), it 
now follows from Notations 1.1(G) that H G A( m a / 2 ,2&)- Hence by (3.17)-(3.18) and the 
sentence after (3.5), H G Al- Accordingly (see the sentence after (3.6)) let I' denote the 
element of {1, . . . , L} such that 

Q [ P = H. (3.20) 

Define the array c = c(G) in (3.10) (in a slightly unconventional order) as follows: 
First, 

4 1} :=1 and W G {1, . . . , L} - {£'}, cf ) := 1 /(2bL). (3.21) 

Next, for convenience, referring to (3.7), define the mxm symmetric matrix S := (s^ , 1 < 
i,j<m) as follows: 

V(z,j)G{l,...,m} 2 , Sij := Yl C ? } ?S- (3-22) 

ee{i,...,L}-{t'} 

(By (3.21), S = [7/(26L)]^ e{ i ) ... )jL }-{r} < 3£ 1) ; however, the form (3.22) will be a little 
more natural for the calculations that follow.) Next, use S to continue the definition of 
the array in (3.10) as follows: 

V(u, v) G T, c^} := [g uv - h uv ] - s uv . (3.23) 

Finally, use (3.23) itself to complete the definition of the array in (3.10) as follows: 

Vit G {1, . . . , m}, c^ 2) := [g uu - h uu ] - s uu - ^ c if ■ (3.24) 

(i,j)eT-.ue{i,j} 
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Now recall from the entire last paragraph of Step 3.2 that Qg G A( m , /2,26) f° r every 
£ G {1, . . . , L}. It follows from (3.7) and Notations 1.1(D)(E) (see the third sentence after 

(1.2)) that for each £ G {1,...,L} and each (z,j) G {l,...,m} 2 , < 26. Hence by 

(3.21) and (3.22), 

V(z,j)e{l,...,m} 2 , 1^1 < 7 , (3-25) 

that is, 5eBS[ 7 ], 

Now we shall verify eqs. (3.11)-(3.14) (though not quite in that order). 
First, (3.11) holds by (3.21) and the sentence after (3.9). 
Next, for each (u,v) G T, by (3.23) and (3.18), 

c uv = [9uv ~ Kuvl\ + [^uu7 ~~ h uv ] — s uv = [g U v ~ Kuv'y] + 37 — s uv . (3.26) 

By (3.16) and (3.25), the far right side of (3.26) is bounded below by + 37 — 7 and 
bounded above by 7 + 37 + 7. Hence (3.13) holds. 

Next let us verify (3.12). For any given u G {l,...,m}, the following holds: The 
set {(z, j) G T : u G {z, j}} has exactly m — 1 elements ((1, u), . . . , (u — 1, u) and (77, u + 
1), . . . , (u, m)), and hence by (3.13) (just proved above), 

2(m-l) 7 < i 3) <5(m-l) 7 . (3.27) 

{i,j)eT-.ue{i,j} 

Now by (3.24), 

<4 2) = [g U u - Kuul] + [«uu7 - Ku] - S uu ~ °if- ( 3 - 28 ^ 

(i,j)eT:u6{i,j} 

By (3.16), (3.17), (3.25), and (3.27), the right side of (3.28) is bounded below by O + 87777- 
7 — 57777 and bounded above by 7 + 87777 + 7 — 0. Hence (3.12) holds. 

Finally, (3.14) needs to be verified. First, for G T, by (3.21), (3.22), (3.8), (3.9), 
(3.20) (with (3.7)), and (3.23), 

L m 

Vc (1) fl (1) + Vc( 2 '(i (2) + V c^o (3) - 1 •o (1) +s - + + c (3) • 1 

1=1 u=l (u,v)ET 

= h i:j + s i:j + c\f = g i3 . (3.29) 

Next, recall that the matrices G, Qg, Qu , and Quv (and S) are symmetric. As a trivial 
consequence, for G T, the far left and far right sides of (3.29) remain equal if the 

indices i and j are switched. Finally, for each i G {1, . . . , m}, by (3.21) (again with (3.20)), 

(3.22) , (3.8), (3.9), and (3.24), 

L m 

Vc (1) o (1) + Vc^o (2) + V c^o (3) - l-/7-- + s-- + c (2) -l+ V c (3) -l-o-- 

£=1 u=l (u,»)eT (u,i))eT:i6{u,w} 
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From all of these observations, (3.14) holds. That completes the proof of Lemma 3.4. 



Step 3.5. This step will involve, after some preliminary work, repeated applications 
of Lemma 2.6. The notation fa(/ 5 T(i),T(2),6>,5,e,iV) i n Lemma 2.6 (see the sentence after 
(2.10)) will be used repeatedly, and for typographical convenience it will be written below 
ash{f,T 1 ,T 2 ,e,8,e,N). 

For the use of that notation, define (see (3.1), (3.2), (3.4), and (3.6)) the real numbers 

Ti := log(7/(36L)); T 2 := log2; and 5 := S^r 2 /[2m(L + 1 + m)]) (3.30) 

where in the last equality we are using the notation in Lemma 2.5. By (3.1), (3.4), and 
(3.30), Ti < < T 2 . Referring to (2.6)-(2.7), we shall say that a given real, continuous, 
symmetric function / on [— 7r, n] satisfies "Condition C" if (2.9) and (2.10) hold for the 
given values in (3.30). 

Next, refer to Notations 2.2(B), involving the Fejer kernels. Of course by Fejer's Theo- 
rem, if / is a (say) real, continuous, symmetric function on [— tt, tt], then (27r) _1 f F n (X) ■ 
f(X)d\ converges to /(0) as n — > oo. For a given real, continuous, symmetric function / 
on [— 7r, 7r] and a given e > 0, let Af(f, e) be a positive integer such that 

/ n rl\ 
F n (X)f(X)—<e. (3.31) 

Next, refer to the sequence Gi, G2, G3, ... of matrices in A( m a &) (in fact in A) from 
the second paragraph of Step 3.1. Applying Lemma 3.4 and using the notations there, 
define for each positive integer n the array 

c n = c(G n ) := {eg, i G {1, 2, . . . , L}; c^ n , u G {1, 2, . . . , m}; eg , n , (u, v) G t} (3.32) 

of positive numbers (satisfying (3.11)-(3.14) with G = G n ). By (3.11), (3.12), and (3.13), 
together with (3.30) and the sentence after (3.9), one has that for each positive integer n 
and each number c in the array c n , Ti < logc < < T 2 . 

Now we shall define a sequence of positive integers (No, N\, N2, . . .); and we shall 
define, for each positive integer n, a collection 

Cn := {/£, t G {1, 2, . . . , L}; fi% u G {1, 2, . . . , m}; f^ n , (u, v) G t} (3.33) 

of real, continuous, symmetric functions on [— 7r, tt] that each satisfy Condition C (see the 
sentence after (3.30)). Notice that for a given positive integer n, there will be only finitely 
many functions in this array (3.33) — in fact L + m + m(m — l)/2 of them. The definition 
will be recursive in n, with A^ n _i and C n being defined together for n = 1,2,3,.... It 
proceeds as follows: 

To start off, define the positive integer := 1, and let each of the functions in the 
collection C\ in (3.33) be the trivial constant function with range {0}. Of course a constant 
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function / on [— 7r,7r] satisfies ^(/) = 0. Since Ti < < T 2 (as was noted above), it now 
follows that the (constant) functions in (3.33) (for n = 1) satisfy Condition C. 

Now suppose n > 1 is an integer, and the positive integer iV n _i and the real, con- 
tinuous, symmetric functions in C n in (3.33) have already been defined, and that those 
functions all satisfy Condition C. Define the positive integer 

N n := N n ^ + maxA/V, 2" n ) (3.34) 

where this maximum is taken over all functions / in the collection C n in (3.33) for the 
given n. (Of course for each such /, the notation simply refers to the real, continuous, 
symmetric function A h- >■ e^ x ^ on [— 7r, it].) Now referring to (3.30), (3.32), and the sentence 
after (3.32), and applying Lemma 2.6, define the functions in the collection C n +i as follows: 

First, for each i G {1, . . . , L}, define the function „ +1 by 

/S+i := KfQ^i^2,logc^ n+1 ,S,2- n ,N n ). (3.35) 
Next, for each u G {1, . . . , to}, define the function „ + i by 

/S+i := M/S,^,^,^^^^-,^). (3.36) 
Finally, for each (u, v) G T, define the function fj^l n+1 by 

f£l, n+ i ■■= KfSln^i^2,logc^ n+1 ,S,2- n ,N n ). (3.37) 

That completes the definition of the collection C n +i. Note that from (2.11)-(2.12) in 
Lemma 2.6, each of the functions in this collection C n+ i satisfies Condition C. 

That completes the recursive definition of the positive integers Nq, Ni, N2, . . . and the 
collections C n ,n G N. From (3.34) and the definition of N , one has that 

1 = N < iVi < N 2 < . . . . (3.38) 

Step 3.6. The next task is to establish a collection 

C := {/f\ t e {1, 2, • • • , L}; /<?>, u G {1, 2, . . . , m}; fi% (u, v) G t} (3.39) 

of "limit functions" on [— 7r, 7r] from the collections C n . 

First suppose £ G {1, . . . , L}. For each positive integer n, from (3.35) and eq. (2.14) in 

Lemma 2.6, one has that \f$ +1 (\) - < 2" n - Hence £^ =1 l/£ + i( A ) " 

f^(X)\d\ < 00. Hence £~ 1 l/g+^A) - /£>(A)| < 00 for a.e. A G [-tt.tt]. Define the 

function a.e. on [— 7r, 7r] as follows: 

/^W^^/SW- (3-40) 
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The right side of (3.40) will be defined in R for a.e. A G [— tt, tt]. On the null-set of values 
A for which that limit does not exist in R, the quantity f^\x) is left undefined here. 

Next, for each u G {l,...,m}, going through the same procedure, but using (3.36) 
instead of (3.35), define the function a.e. on [— tv,tv] by 



Finally, for each (u, v) G T, again going through the same procedure, this time using 
(3.37), define the function fu,v a.e. on [— tt, tt] by 



That completes the definition of the collection C in (3.39). Since each of the functions 
in each of the collections C n is real and symmetric and satisfies Condition C, it follows 
from (3.40)-(3.42) that each of the functions in the collection C is a.e. real and symmetric, 
with its range being bounded a.e. within the closed interval [Ti, T 2 ]. 

Step 3.7. Next some calculations involving Fejer kernels will be given. Later on, 
they will play a key role in obtaining bounds on the covariance matrices for partial sums 
of sequences of random vectors (R m -valued random variables). 

For each positive integer n, define the array 



< ■■= {cff,t e {1, 2, . . . , L}; <g), u G {1, 2, . . . , m}; c* u %, (u, v) G t} (3.43) 



of positive numbers as follows: First, for each £ G {1,...,L}, referring to (3.38), (3.40), 
and (2.4), define the positive number 



/( 2 )(A) := lim /( 2 )(A). 

n— >oo ' 



(3.41) 



fi%\) := lim fi% n (X). 



(3.42) 




(3.44) 



Next, for each u G {1, 



. . , m}, referring to (3.41), define the positive number 




(3.45) 



Finally, for each (w, v) 



G T, referring to (3.42), define the positive number 




(3.46) 



That completes the definition of the array c* in (3.43). 

Our next task is to compare the arrays c n and c* in (3.32) and (3.43). 
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To start that process, suppose n > 2, and suppose £ G {1, . . . , L}. By (3.34), N n > 
AT {exp fft,2- n ); and hence by (3.31), 



exp(/i>))" P F N(n) (X) ■ eMft 

J — 7T 



< 2" 



(3.47) 



Also, for each integer p > n, one has that f[ := h(f^J, Ti, T 2 , log<4^ +1 , 5, 2 p , jV p ) by 
(3.35), and since iV n < N p by (3.38) one therefore has from eq. (2.15) in Lemma 2.6 that 



" *V<») • exp(/« + i( A ))^ - /" *V<») ' exp(/#(A))g 
By (3.47) and (3.48), using a telescoping sum, one has that 



< 2~ p . 



(3.48) 



Vp > n + 1, 



exp(/g(0)) - F N(n) (A) • exp(4 1 p ) (A))^ 

< 2 _n + [2 _n + 2 _(n+1) + . . . + 2 _(p_1) ] < 3 • 2" 



(3.49) 



Now recall that for each p > 1, the function satisfies Condition C and is therefore 

bounded between Ti and T 2 , and hence the function exp fj 1 } is bounded between expTi 
and exp Y 2 . Since any given Fejer Kernel is bounded, one now has by (3.44), (3.40), (3.49), 
and dominated convergence (taking the limit as p — > oo) that for our given fixed n and £, 



exp(4 1 n ) (0))-c* ( n 1) | = exp(/j>))- f F Ar(n) (A)-exp(/, (1) (A)) 

J —TV 



dX 
2^ 



< 3-2" 



(3.50) 



Recall our supposition here that n > 2. From (3.35) (with n + 1 replaced by n) and eq. 
(2.13) in Lemma 2.6, one has that 



l/S(0)-logc2|<2-(- 1 ) 



(3.51) 



Since /j 1 ^ satisfies condition C, one trivially has (see (3.30) and the sentence after it) that 

/in(0) ^ l°g 2- From the sentence after (3.32), one also has that logc^ < < log 2. 
Since de x /dx = e x < 2 for x < log 2, it now follows from (3.51) and trivial calculus that 



exp(/j 1 n ) (0)) - c^| < 4 • 2" n . Hence by (3.50), |c 



,(!) 



< 7-2" 



Let us display for convenient reference what we have just verified: 
Vn > 2, W e {1, . . . , L}, |c* ( n 1} - c£| < 7 • 2"". 



(3.52) 



With arguments exactly analogous to that of (3.52), using (3.41)-(3.42) and (3.45)-(3.46) 
in place of (3.40) and (3.44), one has that 



Vn>2, V«G{l,...,m}, _ C W\ < 7 . 2 " 
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(3.53) 



and that 

Vn>2, V(«, V )GT, |<^ n -ci 3 ) )n |<7-2-. (3.54) 
We shall return to (3.52)-(3.54) later on. 

Step 3.8. Our task in this step is to construct the random sequence X for Theorem 
1.4. That will be done with a family of "building blocks" that are independent of each other, 
each one being a stationary real mean-zero Gaussian random sequence with a particular 
spectral density function. We shall use the well known fact that any real, nonnegative, 
Borel, symmetric, integrable function on [— tt, tt] is the spectral density function of some 
stationary real mean-zero Gaussian random sequence. 

Refer to (3.40), (3.41), and (3.42). For each £ G {1, . . . , L} and each p G {1, . . . , to}, 
let X^'P) := (X ( k 1Ap \ k G Z) be a stationary real mean-zero Gaussian random sequence 
with spectral density function exp/j 1 ^ on [—tt, tt]. For each it e {1, ... , to}, let X^ 2 ' u ^ := 
(xj^ ,u \k G Z) be a stationary real mean-zero Gaussian random sequence with spectral 

density function exp/£ 2) on [-n,n]. For each (u,v) G T, let X^ u ^ := (xj?' u ' v \k G Z) 
be a stationary real mean-zero Gaussian random sequence with spectral density function 
exp/u^ on [— 7r,7r]. Let these random sequences be constructed in such a way that they 
are all independent of each other. 

Refer to Notations 1.1(C). For each £ G {1, . . . , L}, let {Q^) 1 ^ 2 denote the symmetric 

positive definite to x to "square root" matrix of Qp . (Recall the sentence after (3.7).) 

Define the sequence X := k G Z) of R m -valued random variables as follows: For 
each fceZ, 



(l,£,m) 1 



+ J2 x{ k^u+ £ *f U,t We,). (3.55) 
u—i (u,u)eT 

Here and below, for p G {1, . . . , to}, e p := [0, . . . , 0, 1, 0, . . . , 0]* where the 1 is the p th 
coordinate. The first sum in the right side of (3.55) involves matrix multiplication; the 
other two involve simple scalar multiplication. By elementary arguments, X is a strictly 
stationary, Gaussian sequence of R m -valued, mean-O m random variables. Our task now 
is to verify properties (l)-(4) stipulated in Theorem 1.4. The "mixing properties" (l)-(3) 
will be verified in Step 3.9, and property (4) will be verified in Step 3.10. 

Step 3.9. In this step, the mixing properties (1), (2), and (3) stipulated in Theorem 
1.4 will be verified (though not in that order). 

For each positive integer n, by (3.55) and Lemma 2.1 (and the independence of the 
"building block" sequences in the second paragraph of Step 3.8), 

p(X,n) <max{ max p(X^' e ' p \n), max p(X^ 2 ' u \n), max p(X^' u ' v \n)\ 

ll<e<L,l<p<m l<u<m (u,v)ET ) 

(3.56) 
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and 



L m m 

I(X,n) < ^^I(X^ e ' p \n) + ^2l(X^' u \n) + J2 I(X (3,u ' v) ,n). (3.57) 

£=lp=l u=l (u,v)ET 

Next some calculations connected with information regularity are needed for the 
"building block" sequences. 

Referring to the sentence containing (3.33), one has that for each £ G {1, . . . , L} and 
each positive integer n, Ti < /j^(A) < Y 2 for all A G [— tt, n], and also „) < 5. Hence 

for each I G {1,...,L}, by (3.40) and Notations 2.4(C), ^(/ € (1) ) < 5. Hence for a given 
£ G {1, . . . , L} and a given p G {1, . . . , m}, by the second paragraph in Step 3.8, one has 
from (3.30) and Lemma 2.5 that (i) I(X^' l ' p \ 1) < r 2 /[2m(L + 1 + m)], and hence by 
[3, v3, Lemma 27.9(1) (II)] , one also has that (ii) p{X^ p \l) < [2I(X^' e 'P\ l)] 1 / 2 < r, 
and that (hi) I(X^ 1 ' i ' p \n) — > and p(X( 1 ' e > p \ n) — > as n — > oo. By exactly analogous 
arguments, using (3.41) and (3.42) in place of (3.40), one obtains (i), (ii), and (iii) with 
X (2,u) ( for u G {i 5 . . . ? m }) and with X( 3 ' u ^ (for (u, v) G T) in place of X^ p \ 
Hence by (3.55) and (3.57) (and (3.2)), 

I(X, 1) < [mL + m + m(m - l)/2] • r 2 /[2m(L + 1 + m)} < r 2 < r; 

and hence by (1.8), a(X,l) < fi(X,l) < r; and also by (3.55) and (3.56), p(X,l) < r. 
Also, by (3.55), (3.56), and (3.57), I(X,n) — > and p(X,n) — > as n — > oo; and hence 
also by (1.8), a(X,n) — >■ and f3(X,n) — >■ as n — >■ oo. Thus properties (2) and (3) in 
Theorem 1.4 hold. 

Next, recall from above that for a given £ G {1, . . . , L} and a given positive integer 
n, one has that Ti < /^(A) < T 2 for all A G [— 7r,7r]. Hence by (3.40), for a given 

£ G {1, . . . , L}, Ti < / £ (1) (A) < T 2 for a.e. A G [— 7r,7r]. Hence by the second paragraph of 
Step 3.8, for a given £ G {1, . . . , L} and a given p G {1, . . . , m}, the stationary Gaussian 
sequence X^ 1 ^^ has a spectral density function that is bounded a.e. between the two pos- 
itive constants expTi and exp Y 2 , and hence by Lemma 2.3 it satisfies p* (X^ 1,e,p \ 1) < 1. 
By exactly analogous arguments, using (3.41) and (3.42) in place of (3.40), one has that 
p*(X^ u \l) < 1 for u G {1, . . . , m} and that p*(X^ v \l) < 1 for (u,v) G T. Now by 
(3.55) and Lemma 2.1, eq. (3.56) holds with each p replaced by p* . It now follows that 
p*(X, 1) < 1. Thus property (1) in Theorem 1.4 holds. 

Step 3.10. In this final step, we shall verify property (4) in Theorem 1.4, by showing 
that for the sequence (N±, A^ 2 , AT 3 , . . .) of positive integers defined in Step 3.5 (see (3.38)), 
there exists a positive number 6 such that (3.3) holds for all n > 2. 

Refer again to the second paragraph of Step 3.8, where the sequences X( 1,i,p \ X( 2 ' u \ 
and X( 3 ' u,v ^ are defined. One of course has that for each £ G {1,...,L}, each p G 
{l,...,m}, and each n G N, E[n~ 1 / 2 S(X( 1 ' e,p \ n)] = 0; and the analogous comment 
applies with x( 1 ' i ' p ) replaced by X^ 2 ^ or x( 3 ' u > v \ (That should be kept in mind in the 
calculations that follow.) By (3.44) and Notations 2.2(B) (C) (and the second paragraph 
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of Step 3.8), for each £ G {1, . . . , L}, each p G {1, . . . , m} and each n G N, 

£[iV~ 1/2 £(X (M ' p) , iV n )] 2 = jy N{n) (X).eMfi 1) W)^ = cZ ) . (3.58) 

By similar arguments using (3.45) and (3.46) in place of (3.44), one has that for each 
u G {1, . . . , m} and each n G N, 

^F iV(n) (A).exp(/( 2 )(A))^ = C ;g), (3.59) 

and that for each (u,v) G T and each n G N, 

^ Fjv( n ) (A) • exp(/( 3 )(A))- = c* u %. (3.60) 

In what will now follow, we shall repeatedly use the fact that if V is an R m -valued 
random variable such that EV = m and i?||y|| 2 < oo, then the m x m covariance matrix 
can be written simply as = EVV f . 

For each £ G {1, . . . , L} and each n G N, define the R m - valued random variable 

y W : = n- 1 / 2 [S(X^ 1 \n),S(X^ i ' 2 \ n), . . . , S(X^ l ' m \ n)]\ 

By (3.58) and the independence of the sequences X^ 1,e,p \ p G {l,...,m} (again see 
the second paragraph of Step 3.8), one has that for each I G {1,...,L} and each n G 

N, the R m -valued random variable has mean vector m and covariance matrix 

^^jv(n)(^v(n))* = c e n^rn- Hence for each £ G {1, . . . , L} and each n G N (recall that the 
matrix (Q^) 1 ^ 2 is symmetric), the R m -valued random vector 

N(n) 

iv„- 1/2 E(^ 1> ) 1/2 [^ 1A1 ',4 M ' 2) ,---,4 M "" , ] t = (Qj 1, ) 1/2 ^ ) 

fc=i 

has mean vector m and covariance matrix 

^(^V 72 ^)^))^^^) 1 / 2 ) 4 = (q^V^^cq^) 1 / 2 = c ;Wqw. (3.6i) 

By (3.59) and the entire sentence containing (3.8), for each u G {l,...,m}, the 
Revalued random variable N~ 1/2 ^fj 7 , ' M) e u = N~ 1/2 [S(X^ U \ N n )]e u trivially has 
mean vector m and covariance matrix 

C u,n e u e u = C u,nQu ^ (3.62) 

Similarly, by (3.60) and the entire sentence containing (3.9), for each (u, v) G T, the R m - 
valued random variable N~ 1/2 X^ u ' v) (e u + e v ) = N~ 1/2 [S(X( 3 ^ V \ N n )](e u + e v ) 

has mean vector m and covariance matrix 

c u,J,n( e u + e„)(e u + e„) = cJ-^^Q^J,. (3.63) 
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Now we use the elementary equality T,y+z+...+v = £y + £z + - . . + Ey for an arbitrary 
finite collection Y, Z, . . . , V of independent R m -valued random variables whose coordinates 
have finite second moments. By (3.55) and the independence of the sequences in the second 
paragraph of Step 3.8, followed by the entire sentences containing (3.61), (3.62), and (3.63), 

— 1/2 

one has that for each n G N, the R m -valued random variable N n S(X, N n ) has mean 
vector m and covariance matrix 

L m 

G;:=E< ( n 1) ^ 1) + E<S ) Qi 2) + E <%Q%- ( 3 - 64 ) 

1=1 u=l (u,v)€T 

Now from (3.32) and (3.14), for each n G N, 

L m 

G„ = E c S^ 1) + E c iW ) + E c iln«- ( 3 - 65 ) 

£=i «=i (u,»)eT 

Recall from the final paragraph of Step 3.2 that G A( ma / 2 ,2&) f° r each £ G 

{1, . . . , L}. By (3.7) and Notations 1.1(D) (E) (see the third sentence after (1.2)), one has 
that \quj | < 2b for each I G {1, . . . , L} and each (i, j) G {1, . . . , m} 2 . Taking that together 
with the entire sentences containing (3.8) and (3.9), and then using (3.52), (3.53), and 
(3.54), one obtains from (3.64) and (3.65) that for each n > 2, 

G* n - G n G [((26 • L) + (1 • m) + (1 • m(m - l)/2)) -7 • 2"" 

Referring again to the entire sentence containing (3.64), one has that for the positive num- 
ber G := 7 • [2bL + m + m(m — l)/2], eq. (3.3) holds for all n > 2. That completes the 
proof of property (4) in Theorem 1.4. The proof of Theorem 1.4 is complete. 
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